Image displaying method, image displaying program, and display

ABSTRACT

An image displaying method of displaying an image selected from images stored in an image storing apparatus onto a display has the step of displaying the image selected from the images stored in the image storing apparatus into a partial area on the display based on a relative positional relation between the image storing apparatus and the display.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention relates to an image displaying method of arranging aplurality of images on a display, a program for executing the imagedisplaying method, and a display which is used for displaying theimages.

2. Related Background Art

Various methods of arranging a plurality of images photographed by adigital camera in a desired layout have been proposed. For example, amethod whereby a layout according to the number of images to bedisplayed is selected from prepared layouts and image data, characterdata, and figure data are inserted and arranged has been disclosed inJapanese Patent Application Laid-Open No. H07-184032. Another methodwhereby a sheet describing a pattern which designates a layout and asheet to designate image data to be arranged are read, therebydesignating the layout, has also been disclosed in Japanese PatentApplication Laid-Open No. H10-051576. However, according to thoseproposed methods, the layouts have been predetermined and the imagescannot be freely arranged. Therefore, for example, in a layout includingan overlap of the images, there is a case where important areas areoverlapped depending on contents of the images to be displayed. Thereis, consequently, a case where those methods are not proper with theimportant areas hidden or the like. In the case where the user enjoysconversation according to the image contents while displaying suchimages onto a TV apparatus disposed in a living room or the like, thereis needed a more interactive image layout in line with the imagecontents or the conversation that is taking place.

According to many user operating techniques regarding a figure layoutfor a personal computer, in the case of freely arranging image data, theoperation to select the image and the operation to arrange the selectedimage are necessary. FIG. 12 is a diagram showing an example of adisplay for such operations. In the diagram, reference numeral 900denotes a display of an application for freely arranging the image dataand displaying; 901 an icon display section in which icons 902 of imagesserving as a plurality of candidates are displayed in order to selectthe image to be displayed; 903 a plurality of display images arranged ona display screen; and 904 a cursor indicator showing an operation targetamong the display images 903 or the icons 902.

When the user intends to select one of the images displayed in the icondisplay section 901 and arrange it in an arbitrary position on thedisplay 900, first, in an icon selecting mode, he shifts a cursor to theicon display section 901 and moves the cursor onto the icon 902 of theimage to be displayed among the icons 902. Subsequently, the decidingoperation to select the icon 902 is executed, the operation mode isshifted to an icon moving mode, thereafter, the icon 902 with the cursorindicator 904 is moved to the arbitrary position, the layout decidingoperation is executed, and a display state is decided. That is, theoperation to move the cursor for two operations such as operation toselect the image to be displayed and operation to decide the displayposition are, respectively, necessary.

Such an operating method can be relatively easily executed in the caseof using an operating device such as a mouse pointer or executing theoperation such as a pen-input which can directly designate an arbitraryposition on a display screen and directly move the cursor as anoperation target to the designated position.

In the case of a television receiver or an AV apparatus which is used ina living room at home, however, the apparatus is not in an environmentwith a space to operate the mouse pointer, pen input device, or the likein front of the display screen. Therefore, such operations are generallyexecuted by operating a remote controller device which is held by a handand operated with buttons.

If the user tries to execute the foregoing cursor moving operation bydirection buttons provided on the remote controller, for example, in thecase where the cursor indicator 904 shown in FIG. 12 is moved in theicon display section 901, it is moved by the distance corresponding toone icon by the single button operation. Therefore, many cursor movingoperations are needed to select the icon 902 existing at a remoteposition in the icon display section 901. When the cursor is moved to anarbitrary position in the display 900, the button operation is necessaryevery moving step. Therefore, the operation to move the cursor to theremote position is troublesome and it is difficult to construct apreferable operating system in any of the above-mentioned cases.

As another known technique regarding the foregoing technique, there isone disclosed in Japanese Patent Application Laid-Open No. 2003-051981.

SUMMARY OF THE INVENTION

It is an object of the invention to improve the operability of theoperation for arranging images onto a display.

According to the first invention, there is provided an image displayingmethod of displaying an image selected from images stored in an imagestoring apparatus onto a display, comprising the step of displaying theimage selected from the images stored in the image storing apparatusinto a partial area on the display based on a relative positionalrelation between the image storing apparatus and the display.

According to the second invention, there is provided a display having animage display unit, comprising: a position information input unit forinputting position information of an image storing apparatus; and adisplay controller for displaying an image based on image data stored inthe image storing apparatus into a partial area on the image displayunit which has been determined on the basis of the position informationin the image storing apparatus inputted by the position informationinput unit.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block constructional diagram of a digital television whichis used in an image displaying method according to the embodiment 1 ofthe invention;

FIG. 2 is a block constructional diagram of a digital camera which isused in the image displaying method according to the embodiment 1 of theinvention;

FIG. 3 is an external view of the digital camera according to theembodiment 1 of the invention;

FIG. 4 is a flowchart showing a procedure of the image displaying methodaccording to the embodiment 1 of the invention;

FIGS. 5A, 5B, 5C, 5D, 5E, 5F and 5G are explanatory diagrams of aspecific procedure of the image displaying method according to theembodiment 1 of the invention;

FIG. 6 is a constructional diagram of a whole system which is used in animage displaying method according to the embodiment 2 of the invention;

FIG. 7 is a block constructional diagram of a digital television whichis used in the image displaying method according to the embodiment 2 ofthe invention;

FIG. 8 is a block constructional diagram of a digital camera which isused in the image displaying method according to the embodiment 2 of theinvention;

FIG. 9 is a flowchart showing a procedure of the image displaying methodaccording to the embodiment 2 of the invention;

FIG. 10 is a schematic diagram showing an example of the state whereimages are displayed by the image displaying method according to theembodiment 2 of the invention;

FIGS. 11A, 11B, 11C, 11D, 11E, 11F and 11G are schematic diagramsshowing an example of the state where images are displayed by the imagedisplaying method according to the embodiment 2 of the invention; and

FIG. 12 shows an example of a layout displayed by an image displayingmethod according to the prior art.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A best mode for carrying out the invention will be specificallydescribed in detail hereinbelow on the basis of embodiments withreference to the drawings. However, as for dimensions, materials,shapes, relative layouts, and the like of component elements disclosedin the embodiments, the scope of the invention is not limited only tothem unless otherwise specified.

Embodiment 1

An image displaying method according to the embodiment 1 of theinvention will be described with reference to FIGS. 1 to 5A through 5G.

In the embodiment, the case of using an image displaying systemconstructed by a digital camera and a digital television having afunction of visualizing image data photographed by the digital cameraand viewing an obtained visual image will now be described as anexample.

FIG. 1 is a block constructional diagram of the digital television whichis used in the image displaying method according to the embodiment 1 ofthe invention. In the diagram, reference numeral 101 denotes a tuner. Abroadcast signal from a receiving antenna (not shown) of a digitalbroadcast and a broadcast signal of a CATV are inputted to the tuner101. The tuner 101 selects a predetermined transmission channel from thereception signal on the basis of control of a display controller 111,which will be explained hereinafter, executes demodulation, errorcorrection, and the like to reception data in the received transmissionchannel, and outputs a transport stream (TS) signal. Reference numeral102 denotes a demultiplexer. The demultiplexer 102 extracts programlayout information from the TS signal, outputs it to the displaycontroller 111, which will be explained hereinafter, and separatestarget video signal, audio signal, and digital broadcasted data from theTS signal in accordance with the control of the display controller 111.The audio signal is decoded by an audio video decoder 103 and outputtedas an audio sound from an audio output unit 104 including a D/Aconverter. The video signal is decoded by the audio video decoder 103,temporarily written into a video memory 107, and thereafter, displayedonto a display 113 through a video synthesizing unit 108. As a deviceconstructing the display 113, for example, there are a flat displaypanel having a matrix electrode structure such as a liquid crystaldisplay or a plasma display, a CRT (cathode ray tube), or the like. Theseparated digital broadcasted signal is stored into a memory 112 and itis read out and outputted to the display controller 111 when the userviews the digital broadcast.

Reference numeral 110 denotes an operation input unit. The operationinput unit 110 includes a receiving unit of a remote controller using aninfrared signal and operation switches which are directly provided for adigital television 100, inputs the operation of the user, and sends itto the display controller 111. The operation input of the user which isreceived from the operation input unit 110, the program layoutinformation which is received from the demultiplexer 102, or the digitalbroadcasted data read out from the memory 112 is inputted to the displaycontroller 111 and the display controller 111 makes the followingcontrol. That is, on the basis of those input data, the displaycontroller 111 writes graphic data to be presented to the user into thevideo memory 107. The video signal from the audio video decoder 103 anda still image signal photographed by the digital camera, which will beexplained hereinafter, are properly synthesized by the videosynthesizing unit 108 and displayed onto the display 113. The digitaltelevision 100 receives the digital broadcast on the basis of theoperation of the user by the integrated control operation of the displaycontroller 111 in the foregoing component elements, thereby enabling theuser to view a target broadcast program.

In the digital television 100, reference numeral 105 denotes a memorycard I/O unit. By connecting the memory card I/O unit 105 to adetachable memory card in which image data photographed by a digitalcamera 200, which will be explained hereinafter, has been stored, thememory card I/O unit 105 inputs and outputs image data including thephotographed image data and additional information. The memory card I/Ounit 105 stores the read data as an image file into the memory 112. Thedisplay controller 111 outputs a display serving as a graphical userinterface to the video memory on the basis of a program which haspreviously been stored and allows it to be displayed on the display 113.Further, in accordance with the user operation which is inputted throughthe operation input unit 110, the display controller 111 reads out theimage data obtained from the memory card or the image file stored in thememory 112 and sends it to an image processing unit 106. In the imageprocessing unit 106, the image data is decoded and synthesized withgraphic data for operation in the video synthesizing unit 108 throughthe video memory 107. The synthesized image is displayed onto thedisplay 113.

Reference numeral 109 denotes a wireless I/O (input/output) unit. Thewireless I/O unit 109 communicates with a wireless I/O unit 208 of thedigital camera 200, which will be explained hereinafter, and transmitsthe control data and the image file. That is, the wireless I/O unit 109has a function of a position information input unit for inputtingposition information of the digital camera 200, which will be explainedhereinafter. The received photographed image file data of the digitalcamera is stored as an image file into the memory 112 in a mannersimilar to the image data inputted from the memory card I/O unit 105.The image based on the received photographed image file data of thedigital camera is displayed onto the display 113 through the imageprocessing unit 106. As means for wireless communication, a wireless LANaccording to IEEE802.11b, a short range wireless method according toBluetooth (registered trademark), or the like is used.

In the digital television 100, by the integrated control operation ofthe display controller 111 in the foregoing component elements, theimage photographed by the digital camera 200 can be viewed on the basisof the operation of the user.

FIG. 2 is a block constructional diagram of the digital camera which isused in the image displaying method according to the embodiment 1 of theinvention. In the diagram, reference numeral 201 denotes an imagepick-up unit of the digital camera which includes an optical system suchas a lens, diaphragm, or the like, an image pick-up device, a devicedriving circuit, and the like, electronically photographs an image, andoutputs non-compression image data. Reference numeral 202 denotes acompression and decompression unit for compressing the non-compressionimage data, decompressing the compression image data read out of arecording media through a memory card I/O unit 206, and outputting animage data signal to be displayed onto a display 203. Reference numeral206 denotes the memory card I/O unit 206. The memory card I/O unit 206constructs an image file by adding necessary additional data to thecompressed image data and stores it into a memory card 209 as arecording media. The memory card I/O unit 206 reads out the image filefrom the recording media and extracts the compression image data to bedisplayed on the display 203 or necessary information. The display 203is constructed by, for example, a liquid crystal display (LCD). In placeof the liquid crystal display, an organic EL display or another flatpanel display can be also used.

Reference numeral 208 denotes the wireless I/O unit. The wireless I/Ounit 208 communicates with the wireless I/O unit 109 of the digitaltelevision 100 and transmits the image data and the control information.The image data is read out by a controller 205 from the image file whichhas been photographed by the digital camera 200 and stored in the memorycard 209 and is supplied to the wireless I/O unit 208. The control datais data which is formed by the controller 205 on the basis of theinformation which is outputted from an operation input unit 204 and aposition detector 207. The wireless LAN according to IEEE802.11b, theshort range wireless method according to Bluetooth (registeredtrademark), or the like is used as means for wireless communication asalready mentioned in the wireless I/O unit 109 of the digitaltelevision.

Reference numeral 207 denotes the position detector. The positiondetector 207 inputs the operation to the digital camera 200 when theuser moves the main body of the digital camera 200 in the up/downdirections, right/left directions, or front/rear directions or inclinesit. In the embodiment, an XYZ-triaxial acceleration sensor is used forthe position detector and the moving direction, a movement amount pertime, and an angle of rotation are outputted in accordance with anoutput signal of the acceleration sensor.

Reference numeral 204 denotes the operation input unit including ashutter button serving as a trigger for photographing,direction/decision buttons for selecting and deciding a display image.The operation input unit 204 is used to input the operation to thedigital camera 200 of the user.

FIG. 3 is an external view of the digital camera according to theembodiment 1 of the invention. In FIG. 3, an external view (upperdiagram) seen from the top and an external view (lower diagram) seenfrom the back surface are illustrated. These diagrams are shown toexplain elements such as buttons and the like constructing the operationinput unit 204 described with reference to FIG. 2. In FIG. 3, referencenumeral 221 denotes a power button. By operating the power button 221, apower source of the digital camera 200 is turned on or off. Referencenumeral 222 denotes a shutter button. By completely pressing the shutterbutton 222, the trigger operation is given to the image pick-upoperation upon photographing. By pressing the shutter button 222 to thehalf position, the focusing operation for photographing is started andthe display regarding the photographing conditions is started justbefore photographing. Reference numeral 223 denotes zoom buttons. Bypressing the zoom buttons, the zooming operation upon photographing isexecuted. The zoom buttons 223 are used to enlarge or reduce a displayimage when the photographed image is viewed. Reference numeral 224denotes a finder to confirm a photographing range through the lens ofthe image pick-up unit (not shown). Reference numeral 225 denotes aswitch to change over the operation mode of the digital camera 200. Bypressing the switch 225, it is possible to select one of a photographingmode to photograph the image by the image pick-up unit 201, areproducing mode to display the photographed image stored in the memorycard 209 onto a liquid crystal monitor 226 and view it, and a televisionviewing mode to display the photographed image stored in the memory card209 onto the display 113 of the digital television 100 and view it.Reference numeral 227 denotes direction/decision buttons to execute theoperation for moving a focal point on the graphic data regarding theoperation which is displayed on the display 203, selecting an operationitem, and deciding it. Reference numeral 226 denotes the liquid crystalmonitor constructing the display 203 and 228 indicates other operationbuttons.

In FIG. 2, reference numeral 205 denotes the controller for organicallycontrolling the component elements of the digital camera 200 describedabove and providing functions of the digital camera to the user. Thecontroller 205 allows the display 203 to display graphic elements forallowing the user to set the digital camera 200 into a state suitablefor the target photographing and controls operating conditions of eachunit of the digital camera 200 on the basis of the user operation whichis inputted through the operation input unit 204. When the digitalcamera 200 is set to the photographing mode, the input state of theimage to the image pick-up unit 201 directed toward an object issuccessively displayed on the display 203 through the compression anddecompression unit 202. Therefore, the display 203 functions as afinder. When the user presses the shutter button of the operation inputunit 204 at the moment when he determines that the target photographingconditions are satisfied, the controller 205 controls the light emissionof stroboscopic means (not shown) in accordance with the settings andallows the compression and decompression unit 202 to compress the imagedata photographed by the image pick-up unit 201 at that timing. Thecontroller 205 further obtains present time/date data from a calendarclock (not shown) and constructs an image file as additional informationtogether with the information of the digital camera and informationregarding the photographing conditions. The controller 205 stores theimage file into the memory card 209 through the memory card I/O unit206.

When the digital camera 200 is set to the reproducing mode, thecontroller 205 reads out the photographed image data from the image datastored in the memory card 209 through the memory card I/O unit 206 andallows the display 203 to display it through the compression anddecompression unit 202. The images as display targets are sequentiallychanged by operating the right/left direction buttons in the operationinput unit 204. The image which is displayed is enlarged or reduced byoperating the zoom buttons in the operation input unit 204. In theenlargement display state, a display area in the image data can be movedby operating the up/down and right/left direction buttons in theoperation input unit 204.

When the digital camera 200 is in the television viewing mode, thephotographed image can be displayed on the display 113 of the digitaltelevision 100 of the present system and viewed by the operation of thecontroller 205 or by operating in association with the displaycontroller 111 of the digital television 100.

FIG. 4 is a flowchart showing a procedure of the image displaying methodaccording to the embodiment 1 of the invention. In this flowchart, theoperation of the digital camera 200 and the digital television 100 inthe television viewing mode will be explained mainly with respect to theflow of the control data and the image data.

The television viewing mode is started when the user executes theoperation to switch the operating mode of the digital camera 200 (stepS101). The controller 205 which detected the switching operation of theoperating mode switch 225 sends an operating mode informationnotification showing that the operating mode has been set to thetelevision viewing mode to the display controller 111 of the digitaltelevision 100 through the wireless I/O unit 208 of the digital camera200 and the wireless I/O unit 109 of the digital television 100 (S102 toS104). Subsequently, the controller 205 of the digital camera 200 makescontrol so that the image data stored in the memory card 209 and servingas a display target is transmitted to the digital television 100 (S105).The image data is transferred to the memory 112 of the digitaltelevision 100 from the memory card 209 in a wireless manner and stored(S106 to S108).

The user who has set the operating mode to the television viewing modeselects the image to be displayed onto the digital television 100 andviewed by using the liquid crystal monitor of the digital television100. That is, when the user operates the right/left direction buttons227 of the digital camera 200, outputs (S109, S112) of the operationinput unit 204 are detected by the controller 205. The controller 205reads out the target image data from the memory card and makes controlso that it is displayed on the display 203 (S110, S113; S111, S114).

When the user finds the image to be displayed, he directs the digitalcamera 200 toward the digital television 100 and presses the shutterbutton 222 to the half position. The output of the operation input unit204 as a temporary displaying operation is detected by the controller205 (S115). In a wireless manner, the display controller 111 of thedigital television 100 is notified of information which designates theselected image and information showing that the temporary selectingoperation has been executed (S116 to S118). The display controller 111reads out the image data of the designated image from the memory 112 andmakes control so that it is displayed on the display 113 through theimage processing unit 106 (S119, S120). The operation in which the imageis displayed on the display 113 denotes the operation in which the imageis displayed in a partial area on the display 113, in other words, theoperation in which the image is displayed in a partial area in an outerperiphery of the display area of the display 113.

The user moves the main body of the digital camera 200 in the up/downand right/left directions or inclines it in the state where the targetimage has been displayed on the display 113 of the digital television100, so that he can adjust the display position such as coordinates,inclination, or the like of the image displayed on the display 113. Thatis, the display controller 111 of the digital television 100 is notifiedof position information such as coordinate information, inclinationinformation, and the like from the controller 205 in a wireless manneron the basis of the movement amount and inclination of the digitalcamera 200 which are detected by the position detector 207 of thedigital camera main body (S121 to S124). On the basis of the notifiedposition information, the display controller 111 controls the videomemory 107 and the video synthesizing unit 108 and controls the displayposition of the image data which is displayed on the display 113 (S125).The notification of the position information is repetitively performedevery detection of the movement of the digital camera 200 or everypredetermined time intervals (S126 to S130 and S131 to S135). The usercan move the image to a desired display position on the display 113.

By fully depressing the shutter button 222 which has been operated tothe half-depressing position by the user, the user can decide thedisplay position of the image displayed on the display 113. That is,when the controller 205 detects the full-depression of the shutterbutton 222 (S136), a display position decision notification is sent tothe display controller 111 of the digital television 100 in a wirelessmanner (S137 to S139). On the basis of this notification, the displaycontroller 111 controls the video memory 107 and the video synthesizingunit 108 and decides the display position of the image data which isdisplayed on the display 113 (S140).

According to the operation described above, the image selected fromimages stored in the digital camera can be displayed on the partial areaon the display based on relative positions of the digital camera and thedisplay. It is to be noted that displaying the relative positions isperformed such that, in relation to the position of one, relativeposition and state or orientation of the other is shown. Accordingly, aninformation of the relative positions includes not only coordinateinformation of the one (camera) the other (display), but also aninformation as to whether a distance between the one and the other isshorter or longer.

FIGS. 5A to 5G are explanatory diagrams of a specific procedure of theimage displaying method according to the embodiment 1 of the invention.That is, FIGS. 5A to 5G are the diagrams for explaining the movement ofthe digital camera main body and the change in the display position ofthe image on the display 113 mentioned above. FIG. 5A is the diagramshowing a positional relation between the digital television 100 and thedigital camera 200. This diagram shows that when the digital camera 200is moved in the up/down and right/left directions or in the rotatingdirection at the position where it faces the display screen of thedigital television 100, the display position of the image displayed onthe display 113 of the digital television 100 is also moved in the samedirection. The image serving as a display target can be selected on theliquid crystal monitor by the right/left buttons of the digital camera200 (FIG. 5B). By half-depressing the shutter button 222, the selectedimage (image B in the diagram) can be displayed on the display 113 ofthe digital television 100 (FIG. 5C). The display position of theselected image can be moved by moving the digital camera 200 (FIG. 5D).The displaying direction can be rotated by rotating the digital camera200 (FIG. 5E). By executing the operation for moving forward the digitalcamera 200 to approach the digital television 100, an overlap relationwith another image can be set in such in a state where the selectedimage B is partially hidden behind the image (image A in the diagram)displayed on the digital television 100 (FIG. 5F). That is, either theimage A or B (to be displayed) can be selected in the overlapped areaportion. Further, the display state can be decided by fully depressingthe shutter button (FIG. 5G). In FIGS. 5A to 5G, as for the selectedimage (image B in the diagram) serving as a target of the positionadjustment, a periphery of the displayed image is displayed in a color,thereby showing that such an image is the operation target. Such afocusing display is finished at a point of time when the display stateis decided (FIG. 5G). Although the operation to change the overlaprelation with another image (image A in the diagram) to the lower statehas been shown in FIGS. 5A to 5G, it can be also changed so that theselected image B is overlapped on the image A by a larger area byexecuting the operation for allowing the digital camera 200 to be farfrom the digital television 100.

Returning to FIG. 4, the operation in the case where the image which hasalready been displayed on the digital television 100 is selected in thedigital camera 200 will be described. In FIG. 4, the image is selectedon the liquid crystal monitor of the digital camera by the operationinput of the user (S151 to S157). The display controller 111 of thedigital television 100 is notified of the designation information of theselected image and the temporary selecting operation by the controller205 in a wireless manner. At this time, if the designated image is theimage which has already been displayed onto the display 113 of thedigital television 100, the display controller 111 sets the image whichhas already been displayed to the target of the display position control(S161 to S163). On the basis of the position information of the digitalcamera 200 which is notified after that, the decided position of thedesignated image is moved and the image is displayed there (S164 toS178).

In the temporary selection display state where the display position ofthe image is moved in accordance with the position of the digital camera200, when the user operates the zoom buttons 223 of the digital camera200, the controller 205 which detected the output (S179) of theoperation input unit 204 sends the zooming operation as display controlinformation to the display controller 111 of the digital television in awireless manner (S180 to S182). The display controller 111 forms anenlarged or reduced image of the image to be displayed through the imageprocessing unit 106 and allows the enlarged or reduced image to bedisplayed on the display 113 through the video memory 107 and the videosynthesizing unit 108 (S183, S184). At this time, the controller 205 ofthe digital camera 200 allows the similar enlarged or reduced image tobe also displayed on the liquid crystal monitor.

When the user operates the direction buttons 227 during theenlarging/reducing operation, the display controller 111 is notified ofthe display control information by a similar path (S185 to S188). In thedisplay controller 111, the center position of the enlarging/reducingdisplay is adjusted and the display area in the image to be displayed onthe display 113 is changed (S189, S190). As already been described, bythe user's operation for fully depressing the shutter button 222 of thedigital camera 200 by, such a display state is determined and thedisplay state on the display 113 of the digital television 100 is fixed(S191 to S195).

As described above, the system of the embodiment has: the step whereinthe image as a display target in the digital camera in which a pluralityof photographed images have been stored is selected and, on the displayof the digital television for displaying the images, the selected imageis displayed in the position corresponding to the relative positionbetween the digital camera and the digital television; and the stepwherein another image selected on the digital camera is furtherdisplayed in another relative position between the digital camera andthe digital television. Thus, the operation to select the image as adisplay target on the display screen of the digital television isunnecessary. Therefore, a layout of a plurality of images can berealized by the simple operation even in an operation environment wherethere is no plane space such as a desk or the like set in a living roomand the input device such as mouse, pen input, or the like which candirectly designate the position in the plane cannot be used.

By directly moving the digital camera main body in which the image datahas been selected and displayed on the liquid crystal monitor, the imageposition on the display of the digital television can be moved.Therefore, it is possible to execute the operation as if the targetphotograph card were moved to the top from a bundle of a plurality ofphotograph cards held in the palm of the user's hand and the bundle ofphotograph cards could be directly moved and put in the desired displayposition. In this manner, the inspirational operation according toactual simulation which can be easily understood can be executed.

The embodiment has been described above on the assumption that the imagedata stored in the memory card of the digital camera is transferred in alump at the start of the operation and only the selection information isnotified upon selection of the image on the digital camera. Such aconstruction is used to reduce a time which is necessary until the imageis displayed on the digital television after the selection of the image.However, if the digital camera has enough performance to transfer theimage data, a construction in which the image data is transferred eachtime the image is selected by the user operation can be also used.

As a method of transferring the image data in a lump, a removable mediasuch as a memory card or the like in which a plurality of image dataserving as display targets have been stored can be moved and connectedfrom the digital camera to the digital television at the start of theoperation or can be previously moved and connected before it. When theimage data is transferred in a lump in a wireless manner, it is alsopossible to use a method whereby at a point of time when the digitalcamera and the digital television recognize each other in a wirelessmanner, the image data is previously transferred and stored into amemory of the digital television before the operating mode is set to thetelevision viewing mode.

A method of using infrared rays can be also used for the wirelesscommunication. However, since it takes time to transfer the image data,if such a method is used together with means for preliminarilytransferring the image data, means for preliminarily moving the imagedata by a memory card, or the like, it is more effective. Even in thecase of the communication using the wired connection, the essence of thepresent invention is not lost so long as it is within a range where themovement of the digital camera is not obstructed.

Embodiment 2

An image displaying method according to the embodiment 2 of theinvention will now be described with reference to FIGS. 6 to 11A through11G.

The embodiment will be explained with respect to an example in the caseof using a system in which the digital camera and the digital videocamera are connected, the digital televisions each having a function forvisualizing the photographed image of the digital camera and allowingthe user to view it are connected by a network, and the viewing of thephotographed image of the digital camera is shared.

FIG. 6 is a constructional diagram of the whole system which is used inthe image displaying method according to the embodiment 2 of theinvention. In FIG. 6, reference numeral 301 denotes a digital television(1) for receiving a broadcast wave through an antenna 302 and viewing atelevision program. The digital television (1) 301 has a function forreceiving photographed image data from a digital camera (1) 304connected by wireless communicating means and displaying it. The digitaltelevision (1) 301 also has a function for transmitting video datashowing a state of the user which is photographed by a digital videocamera (1) 303 connected through a digital video interface and thephotographed image data of the digital camera (1) 304 to a connectednetwork (Internet) 320. The digital video camera (1) 303 is fixed ontothe digital television (1) 301. The digital video camera (1) may beformed integrally within the digital television (1). Alternatively, thedigital video camera (1) may be fixed on a periphery of the digitalcamera. A similar digital television (2) 311 is connected to the network320. The similar digital television (2) 311 displays the received videodata and image data. The digital television (2) 311 has a function forallowing the user to share the viewing of the photographed image of thedigital camera (1) 304 together with the user of the digital television(1) 301.

The digital television (2) 311 has a construction similar to that of thedigital television (1) 301. That is, the digital television (2) 311 has:a function for receiving a broadcast wave through an antenna 312 andallowing the user to view a television program; a function for receivingphotographed image data of a digital camera (2) 314 connected in awireless manner and allowing the user to view a television program; anda function for transmitting video data showing the state of the userwhich is photographed by a digital video camera (2) 313 connectedthrough a digital video interface and the photographed image data of thedigital camera (2) 314 to the network 320. The digital television (1)301 has a function for displaying those received video data and imagedata and allowing the user to share the viewing of them together withthe user of the digital television (2) 311.

FIG. 7 is a block constructional diagram of the digital television whichis used in the image displaying method according to the embodiment 2 ofthe invention. In the diagram, reference numeral 321 denotes a tuner. Abroadcast signal from a receiving antenna (antenna 302 shown in FIG. 10)of a digital broadcast and a broadcast signal of the CATV are inputtedto the tuner 321. The tuner 321 selects a predetermined transmissionchannel from the reception signal on the basis of control of acontroller 330, which will be explained hereinafter, executesdemodulation, error correction, and the like to the reception data ofthe received transmission channel, and outputs a transport stream (TS)signal. Reference numeral 322 denotes a demultiplexer. The demultiplexer322 extracts program layout information from the TS signal, outputs itto the controller 330, which will be explained hereinafter, andseparates target video signal, audio signal, and digital broadcasteddata from the TS signal in accordance with the control of the controller330. The audio signal is decoded by an audio video decoder 323 andoutputted as an audio sound from an audio output unit 324 including aD/A converter. The video signal is decoded by the audio video decoder323, written into a video memory included in a video synthesizing unit327, and thereafter, displayed onto a display 329 through the videosynthesizing unit 327. As a device constructing the display 329, forexample, there are a flat display panel having a matrix electrodestructure such as a liquid crystal display or a plasma display, a CRT(cathode ray tube), or the like.

The separated digital broadcasted signal is stored into a memory 331 andit is read out again and outputted to the controller 330 when the userviews the digital broadcast.

Reference numeral 332 denotes an operation input unit. The operationinput unit 332 includes a receiving unit of a remote controller using aninfrared signal and operation switches which are directly provided forthe digital television (1) 301, inputs the operation of the user, andsends it to the controller 330. The operation input of the user which isreceived from the operation input unit 332, the program layoutinformation which is received from the demultiplexer 322, or the digitalbroadcasted data read out from the memory 331 is inputted to thecontroller 330 and the controller 330 makes the following control. Thatis, on the basis of those input data, the controller 330 writes agraphic signal to be presented to the user into a video memory includedin the video synthesizing unit 327, synthesizes the video signal fromthe audio video decoder 323 and a still image signal photographed by thedigital camera, which will be explained hereinafter, by the videosynthesizing unit 327, and allows the synthesized signal to be displayedonto the display 329. The digital television (1) 301 receives thedigital broadcast on the basis of the operation of the user by theintegrated control operation of the controller 330 in the foregoingcomponent elements, thereby enabling the user to view a target broadcastprogram.

In the digital television (1) 301, reference numeral 333 denotes amemory card I/O unit. By connecting the memory card I/O unit 333 to adetachable memory card in which the image data photographed by thedigital camera (1) 304, which will be explained hereinafter, has beenstored, the memory card I/O unit 333 inputs and outputs image dataincluding the photographed image data and additional information. Thememory card I/O unit 333 stores the read-out data as an image file intothe memory 331. The controller 330 outputs a display serving as agraphical user interface to the video memory on the basis of the programwhich has previously been stored, and allows it to be displayed on thedisplay 329. Further, the controller 330 reads out the image data readout of the memory card or the image file stored in the memory 331 inaccordance with the user operation which is inputted through theoperation input unit 332 and sends the read-out data to a still imagedecoder 326. In the still image decoder 326, the compression-encodedimage data is decoded, a reducing/enlarging process is executed to thedecoded image data as necessary by an image processing unit 328, andthereafter, the processed data is synthesized with the graphic data foroperation by the video synthesizing unit 327. The synthesized image isdisplayed on the display 329.

Reference numeral 334 denotes a wireless I/O unit 334. The wireless I/Ounit 334 communicates with the wireless I/O unit 208 of the digitalcamera (2) 314, which will be explained hereinafter, and transmits thecontrol data and the image file. The received photographed image filedata of the digital camera is stored as an image file into the memory331 in a manner similar to the image data inputted from the memory cardI/O unit 333 and displayed onto the display 329 by processes similar tothe signal processes. As means for wireless communication, a wirelessLAN according to IEEE802.11b, a short range wireless method according toBluetooth (registered trademark), or the like is used.

In the digital television (1) 301, by the integrated control operationof the controller 330 in the foregoing component elements, the imagephotographed by the digital camera can be viewed on the basis of theoperation of the user.

Reference numeral 335 denotes a digital video interface (I/F) unit. Byconnecting the digital video I/F unit 335 to the digital video camera(1) 303, the I/F unit 335 makes communication for controlling thedigital video camera (1) 303 and makes communication of the digitalvideo data. The controller 330 allows an operation panel of the digitalvideo camera (1) 303 by the graphic data which is presented to the userto be displayed on the display 329. The user can operate the digitalvideo camera (1) 303 by operating graphic elements on the operationpanel by the remote controller. That is, on the basis of the operationinput of the user which is inputted through the operation input unit 332in response to the display of the operation panel, the controller 330forms a control command for the digital video camera (1) 303 andtransmits it to the digital video camera (1) 303 through the digitalvideo I/F unit 335. The digital video camera (1) 303 transmits inresponse to this command the video data recorded or the video dataphotographed by the video camera. The video data received through thedigital video I/F unit 335 is sent to the audio video decoder and avideo image and an audio sound are reproduced by the audio output unit324 and the display 329.

As will be explained hereafter, position information comprisingcoordinate information and inclination information of the digital camera(1) 304 is included in the video data. A position information detectoris constructed by the digital video camera (1) 303. A positioninformation input unit is constructed by the digital video I/F unit 335.

For example, high-speed serial communication defined in IEEE1394 can beused to connect the digital video camera (1) 303. The digital videocamera (1) 303 is controlled by a command set based on, for example,“AV/C Camera Subunit Specification” and “AV/C Tape Recorder/PlayerSubunit Specification” defined by “1394 Trade Association” and transfersa video signal in accordance with “IEC61883 Consumer audio/videoequipment-Digital interface”.

By the integrated control operation of the controller 330 in theforegoing component elements, the video image and the audio sound by thedigital video camera can be viewed by the digital television (1) 301 onthe basis of the operation of the user.

FIG. 8 is a block constructional diagram of a digital camera which isused in the image displaying method according to the embodiment 2 of theinvention. The digital camera (1) 304 has a construction which is almostsimilar to that of the digital camera 200 in the embodiment 1 mentionedabove and executes the similar operation. In FIG. 8, component elementswhich have substantially the same construction and execute substantiallythe same function (operation) as those of the digital camera 200described in the embodiment 1 are designated by the same referencenumerals and their description is omitted here. The digital camera (1)304 differs from the digital camera 200 with respect to a point that itdoes not have the position detector. Therefore, a controller 305 differsfrom the controller 205 of the digital camera 200 in the embodiment 1with respect to a point that the controller 305 does not have thecontrol function of the position detector and communication regarding aposition change of the digital camera (1) 304 is not made with thedigital camera 304.

The digital television (1) 301 and the digital camera (1) 304 have beendescribed above. The digital television (2) 311 has substantially thesame construction as that of the digital television (1) 301 and executesthe operation similar to that of the digital television (1) 301. Thedigital camera (2) 314 has substantially the same construction as thatof the digital camera 304 and executes the operation similar to that ofthe digital camera 304. Therefore, their description is omitted here. Inaddition to the operation to view the broadcast program, the operationto view the image of the digital camera, and the operation to view thevideo image of the digital video camera, the digital television (1) 301and the digital television (2) 311 can execute the operation formutually connecting those televisions through a network, mutuallyshowing the figures of the users of both of the televisions to thepartner's digital television, and sharing the viewing of the images ofthe digital cameras. In the embodiment, such an operation is called asynchronous viewing operation.

Since the construction of the digital camera 304 is fundamentally thesame as that of the digital camera 200 shown in FIG. 3 in the embodiment1, the same component elements are designated by the same referencenumerals and their description is omitted.

FIG. 9 is a flowchart showing a procedure of the image displaying methodaccording to the embodiment 2 of the invention. According to thisdiagram, the synchronous viewing operation in the system of theembodiment will be explained with respect to a flow, as a center, of thecontrol data, image data, and video data of the digital televisions (1)and (2), the digital cameras (1) and (2), and the digital video cameras(1) and (2).

The synchronous viewing operation of the digital television is startedwhen the operation to switch the operating mode of the digital camera isexecuted. The user (1) of the digital television (1) 301 sets the switch225 of the digital camera (1) 304 into the television viewing mode(S200). When the digital camera (1) 304 detects this mode, the digitalcamera (1) 304 notifies the digital television (1) 301 of it in awireless manner (S201). In the digital television (1) 301, thecontroller 330 which received such a notification notifies the digitaltelevision (2) 311 of it as operating mode information through a networkinterface unit 338 via the network 320 (S202-1). In the digitaltelevision (2) 311 which received such a notification, a video controlsignal by a command is sent to the digital video camera (2) 313 througha digital video interface unit (S202-2), thereby allowing the digitalvideo camera (2) 313 to output the photographed video signal (S203). Thedigital television (2) 311 which received the video signal transfers itto the digital television (1) 301 through the network 320. In thedigital television (1) 301, the transferred video signal is received bythe network I/F unit 338. The received video signal is sent to the audiovideo decoder through the demultiplexer and outputted by the audiooutput unit 324 and the display 329. That is, the video data obtained byphotographing the state of the user (2) of the digital television (2)311 is transmitted to the digital television (1) 301 and displayed.

In the digital television (1) 301, the display of the video image of theuser (2) is started and the video control signal by the command is sentto the digital video camera (1) 303 through the digital video I/F(S205), thereby allowing the video signal photographed by the digitalvideo camera (1) 303 to be outputted (S206). The digital television (1)301 which received it transfers the video signal to the digitaltelevision (2) 311 through the network 320 (S207). In the digitaltelevision (2) 311, the video image is outputted by the operationsimilar to that of the digital television (1) 301. That is, the videodata obtained by photographing the state of the user (1) of the digitaltelevision (1) 301 is transmitted to the digital television (2) 311 anddisplayed. In this manner, the users (1) and (2) can start a situationlike what is called a videoconference in which they have a conversationwhile looking at the video images of their figures by the digitaltelevision (1) 301 and the digital television (2) 311.

The user (1) selects the image to be viewed by using the liquid crystalmonitor of the digital camera (1) 304 at hand. That is, by operating theright/left direction buttons 227 of the digital camera (1) 304, theimages which are displayed on the liquid crystal monitor aresequentially changed (S208, S209). When the user (1) finds the image tobe displayed, he directs the digital camera (1) 304 toward the digitaltelevision (1) 301 and depresses the shutter button 222 of the digitalcamera (1) 304 to the half position. In the digital camera (1) 304, thedigital television (1) 301 is notified of the detected operation (S211)and the image data of the corresponding image is transmitted to thedigital television (1) 301 in a wireless manner (S213). In the digitaltelevision (1) 301, the digital television (2) 311 is notified of theinformation regarding the temporarily-selected image through the network(S212) and the received image data is transmitted to the digitaltelevision (2) 311 (S214). In the digital television (2) 311, the imagedata received in the network I/F unit 338 is temporarily stored into thememory 331.

In the digital television (1) 301 which received the notification of thetemporary selection from the digital camera (1) 304, the temporaryselecting and transmitting operations are executed under the control ofthe controller 330. That is, the position of the digital camera (1) 304(position to the digital television (1) 301) is detected from the videodata which is inputted from the digital video camera (1) 303 andnotified as coordinate information and inclination information to thedigital television (2) 311.

The function for extracting the coordinate information and theinclination information of the digital camera (1) 304 from the videodata including the position information is executed in an image patterndetector 336 of the digital television (1) 301. The image patterndetector 336 decodes the digital video data which is received by thedigital video I/F unit 335, detects a pre-registered image patternshowing an external view of the digital camera (1) 304 from the videoimage of each frame, and notifies the controller 330 of the detectedimage pattern as coordinate information and inclination information inthe frame plane. The controller 330 transmits the image pattern as aposition information notification to the digital television (2) 311through the network I/F unit 338 in consideration of another operationinput. The position information mentioned here denotes informationincluding the coordinate information and the inclination information.

In the digital television (2) 311 which received the notification of thetemporary selection, the temporary selecting and receiving operationsare executed under the control of the controller 330. That is, the imagedata received from the digital television (1) 301 is multiplexed to thevideo data which is received from the digital television (1) 301 on thebasis of the position information notification that is continuouslyreceived and the resultant video data is displayed.

In the temporary selecting and receiving operations, the controller 330of the digital television (2) 311 sends the image data which has beenreceived through the network and stored in the memory 331 to the stillimage decoder 326 and develops the compression-encoded image. Thenon-compression image data sent to the image processing unit 328 issubjected to an enlarging or reducing process in accordance with thezoom setting based on a display control notification, which will beexplained hereinafter, and the processed image data is written into thevideo memory in the video synthesizing unit 327. In the videosynthesizing unit 327, the image data is synthesized to the intraframeposition of the video data designated by the notified positioninformation and the obtained data is outputted to the display 329. Inthe display 329, the photographed image selected in the digital camera(1) 304 by the user (1) is synthesized and displayed in the position ofthe image of the digital camera (1) 304 shown in the video data.

Subsequently, when the selected image reaches a desired position, theuser (1) fully depresses the shutter button 222 of the digital camera(1) 304, thereby deciding the display position of the image. That is,the digital television (1) 301 is notified of the full-depressingoperation (S218) of the shutter button 222 in a wireless manner. Thedigital television (1) 301 transmits it as a display position decisionnotification to the digital television (2) 311 through the network. Inthe digital television (2) 311, on the basis of the display positiondecision notification received by the network I/F unit 338, thecontroller 330 controls the video synthesizing unit 327 so that thesynthesizing position of the image data to the video data is fixed tothe present position. After that, even if the position of the digitalcamera (1) 304 shown in the video data changes, the position of theimage to be synthesized does not follow the changed position. In thedisplay 329, the image is displayed in the fixed position and a videoimage obtained by photographing the figure of the user (1) is displayedbehind it.

FIGS. 10 and 11A to 11G are schematic diagrams showing an example of thestate where images are displayed by the image displaying methodaccording to the embodiment 2 of the invention. That is, FIGS. 10 to 11Gschematically show the operation of the user and the state of thedigital television in the foregoing operation. FIG. 10 shows a relationbetween the display layouts in the digital television (1) 301 and thedigital television (2) 311 and the display position of the image data onthe digital television (2) 311 to the motion of the digital camera (1)304. In the diagrams, reference numeral 401 denotes a user (1) and thestate where the user (1) grasps the digital camera (1) 304 at the righthand and looks at the display on the digital television (1) 301 isphotographed by the digital video camera (1) 303. Although not shown,the shutter button of the digital camera (1) 304 is in thehalf-depressed state. An image (A) selected by the user (1) 401 isdisplayed on a liquid crystal monitor 402 of the digital camera (1) 304.A state (403) of a partner user is displayed on the display of thedigital television (1) 301. A state of the user (1) 401 himself which isdisplayed on the partner digital television is displayed as a monitoronto a child display screen 404.

Reference numeral 420 denotes a user (2) and the state where he looks atthe display on the digital television (2) 311 is photographed by thedigital video camera 313. A state (422) of the user (1) as a partneruser is displayed on the display of the digital television (2) 311. Astate of the user (2) 420 himself which is displayed on the partnerdigital television is displayed as a monitor onto a child display screen421. In the state (422) of the partner user, an image (A) 422 selectedby the user (1) 401 by using the digital camera (1) 304 is displayed inthe position of the digital camera (1) 304 grasped by the user (1) atthe right hand.

Now, the digital camera (1) 304 grasped by the user (1) 401 at the righthand is moved upward or to the right in a plane which is almost parallelwith the display surface of the digital television (1) 301. Since theposition of the digital camera (1) 304 in the video image which isphotographed by the digital video camera 303 is moved upward or to theleft, the position of the image (A) 422 which is displayed on thedigital television (2) 311 is moved upward or to the left in the displaysurface. That is, the state of the user (1) 401 which is synthesized anddisplayed on the digital television (2) 311 is displayed as if the usergrasped the selected image (A) in place of the digital camera (1) 304and such a state was shown to the user (2) 420. This is true of the casewhere the digital camera (1) 304 is rotated in the plane which is almostparallel with the display surface of the digital television (1) 301.Since such a state is displayed on the child display screen 404 of thedigital television (1) 301, the user (1) can operate the digital camera(1) 304 while confirming an effect of the synthesized video displayscreen.

FIGS. 11A to 11G are diagrams schematically showing the state of theuser until the user (1) 401 selects an image (B) in the digital camera(1) 304, adjusts the display position in the temporary selecting state,and decides the display position and the display state of the digitaltelevision. The leftmost column of each diagram schematically shows thestate where the figure of the user (1) who faces the digital television(1) 301 and is photographed by the digital video camera (1) 303 is seenfrom the back side. The second column schematically shows the state ofthe display of the digital television (1) 301. The third columnschematically shows the state of the display of the digital television(2) 311. The rightmost column schematically shows the state where thefigure of the user (2) 420 who faces the digital television (2) 311 andis photographed by the digital video camera (2) 313 is seen from theback side.

In FIG. 11A, the user (1) 401 selects the image (B) serving as a displaytarget on the liquid crystal monitor by the right/left buttons of thedigital camera (1) 304. The image (A) displayed by the previousoperation is displayed on the display of the digital television (2) 311for displaying such a state and the image of the digital camera (1) 304is displayed. In the digital television (2) 311, by the half-depressionof the shutter button by the user (1) 401, the selected image (B in thediagram) can be displayed in the position of the digital camera (1) 304(FIG. 11B). By moving the digital camera (1) 304 by the user (1), thedisplay position of the selected image can be moved (FIG. 11C). Thedisplaying direction of the image (B) can be rotated by rotating thedigital camera (1) 304 (FIG. 11D). By another operation input of thedigital camera (1) 304, an overlap relation with another image (A)displayed on the digital television (2) 311 can be controlled so thatthe image (B) is displayed behind the image (A) by a larger area (FIG.11E). The display state can be determined by fully depressing theshutter button (FIG. 11F). In FIG. 11F, the image of the digital camera(1) 304 which is displayed on the digital television (2) 311 is hiddenon the back side of the image (B). However, since the display positionof the image (B) has been fixed at a point of time when the displaystate is determined, by moving the digital camera (1) 304, its imageappears on the display of the digital television (2) 311 (FIG. 11G).

With respect to the image (B in the diagram) which has been selected andhas become the target of the position adjustment in the diagrams, theperiphery of the displayed image is colored so as to indicate theoperation target. Such a focusing indication is finished when thedisplay state is determined (FIG. 11F). In FIG. 11E, the operation tochange the overlap relation with another image (A) so that the image (B)is displayed behind the image (A) by the larger area is shown. However,it is also possible to change so that the target image is overlappedover another image by a similar operation input in the digital camera(1) 304.

Returning to FIG. 9, the operation in the case where the image which hasalready been displayed on the digital television (2) 311 is selected inthe digital camera (1) 304 will be described. In the diagram, the imageis selected on the liquid crystal monitor of the digital camera by theoperation input of the user (S250 to S252). The digital television (1)301 is notified of the selected image from the digital camera (1) 304 ina wireless manner (S253). At this time, if the designated image is animage in which the designation for displaying has already been notifiedin the digital television (2) 311, the digital television (1) 301transmits designation information of the selected image and thetemporary-selecting operation to the digital television (2) 311 throughthe network (S254). However, the image data received from the digitalcamera (1) 304 together with such a notification is not transmitted tothe digital television (2) 311. In the digital television (2) 311 whichreceived the image selection and temporary selection notification, theimage which has already been displayed in the control of the controller330 is used as a target of the display position control and thedesignated image is moved to the position according to the notifiedposition information from the position which has already been determinedand is displayed.

In the temporary selection display state where the display position ofthe image is moved in accordance with the position of the digitalcamera, when the user operates the zoom buttons 223 of the digitalcamera (1) 304 (S259), the digital camera (1) 304 notifies the digitaltelevision (1) 301 of the zooming operation in a wireless manner (S260).The digital television (1) 301 notifies the digital television (2) 311of the zooming operation as display control information through thenetwork (S261). In the digital television (2) 311, the image processingunit 328 is controlled under the control of the controller 330 so as toform the enlarged or reduced image of the image to be displayed, and theenlarged or reduced image is displayed on the display 329 through thevideo synthesizing unit 327. At this time, the controller 305 of thedigital camera (1) 304 allows a similar enlarged or reduced image to bealso displayed on the liquid crystal monitor.

When the user operates the direction buttons 227 during theenlarging/reducing operation (S262), the digital television (2) 311 isnotified of the display control information along a similar path (S263,S264). In the digital television (2) 311, the center position of theenlargement/reduction display is adjusted in the video synthesizing unit327 under the control of the controller 330 and the display area of theimage to be displayed on the display 329 is changed. Such a displaystate is determined when the user fully depresses the shutter button 222of the digital camera (1) 304 (S265) and the image synthesizing positionon the display 329 in the digital television (2) 311 is fixed (S266,S267) as already described above.

As described above, according to the system of the embodiment, in thedigital television system in which the digital video cameras areconnected through the network, the video images obtained byphotographing the figures of the users are mutually communicated throughthe network and displayed, and the communication by the video images isrealized, the system has: the step wherein the relative position of thedigital camera grasped by the user to be photographed in front of one ofthe digital televisions is detected in the video data, the user selectsthe image serving as a display target from a plurality of photographedimages stored in the digital camera, and in the other digitaltelevision, the selected image data is synthesized to the positionaccording to the relative position detected in the video data, and thesynthesized image is displayed; and the step wherein another image dataselected by the digital camera is synthesized to another detectedrelative position and the synthesized image is displayed. Thus, when theuser selects the image serving as a display target on the display screenof the other digital television, the selecting operation on the displayscreen becomes unnecessary. Therefore, even in the operation environmentwhere a plane space such as a desk or the like does not exist in aliving room or the like where the digital television is preferablydisposed in a home and the input device such as mouse, pen input, or thelike which designates the position in the display plane cannot be used,the simple operation can be realized and the more smooth videocommunication can be realized.

By directly moving the digital camera main body in which the image datahas been selected and displayed on the liquid crystal monitor, the imageposition on the synthesized display can be moved. Therefore, theoperation which is executed as if the target photograph card were movedto the top from a bundle of a plurality of photograph cards held in thepalm of the user's hand and the bundle of photograph cards could bedirectly moved and put in the desired display position can be realized.In this manner, the inspirational operation which can be easilyunderstood according to actual simulation can be executed.

The embodiments have been described above on the assumption that theimage data stored in the memory card of the digital camera istransmitted through the network each time the image selecting operationis executed. Such a construction is used by presuming a situation inwhich a total data amount of the image data stored in the memory card islarge and is not suitable to transfer all of the image data. However, inthe case where an amount of data which is transferred is proper withrespect to a transfer speed of the network, it is also possible to use aconstruction in which the image data stored in the memory card istransferred in a lump to the other digital television at the start ofthe operation and only the selection information is notified when theimage is selected on the digital camera.

In the construction which presumes the batch transfer of the image dataas a prerequisite, the image data is not always limited to the transferthrough the network but it is also possible to construct the system insuch a manner that a removable media such as a memory card or the likein which a plurality of image data serving as display targets has beenstored is sent to the other user prior to starting the operation andconnected to the other digital television.

A method of using infrared rays can be also used for the wirelesscommunication between the digital camera and the digital television.However, since it takes time to transfer the image data, if such amethod is used together with means for preliminarily transferring theimage data, means for preliminarily moving the image data by the memorycard, or the like, it is more effective. The essence of the presentinvention is not lost even by the communication using the wiredconnection so long as it lies within the scope of the range where themovement of the digital camera is not obstructed.

Although the foregoing embodiments have been shown with respect to theexample in which the still images accumulated in the digital camera aredisplayed on the display screen of the display, motion images can bealso used as images.

The invention is not limited to the foregoing embodiments butincorporates a computer-executable program having program codes whichare executed by a digital television or a set-top box (computer).Therefore, it is also possible to use a construction in which thedigital television or the set-top box (computer) which does not have thefunctions described in the embodiments 1 and 2 is prepared, a programfor executing the methods described in the embodiments 1 and 2 isdownloaded, and the digital television or the set-top box executes themethods described in the embodiments 1 and 2.

This application claims priorities from Japanese Patent Application Nos.2004-106273, filed on Mar. 31, 2004, and 2005-048840 filed on Feb. 24,2005, which are hereby incorporated by reference herein.

1. An image displaying method of displaying an image selected fromimages stored in an image storing apparatus onto a display, comprisingthe step of displaying the image selected from the images stored in saidimage storing apparatus into a partial area on said display based on arelative positional relation between said image storing apparatus andsaid display.
 2. A method according to claim 1, further comprising thestep of, in a state where said image has been displayed in said area,displaying another image which has newly been selected from the imagesstored in said image storing apparatus into another area on said displaybased on a new relative positional relation between said image storingapparatus and said display.
 3. A method according to claim 1, wherein onthe basis of the image selected on said image storing apparatus side andthe relative positional relation to said display, said image storingapparatus transmits an image data of the image to be displayed on saiddisplay and a signal to decide the display area of said image to saiddisplay.
 4. A method according to claim 2, wherein when there is an areawhere said area in which said image is displayed and said another areain which said another image is displayed are overlapped, with respect tosaid overlapped area portion, only one of those images is displayed onthe basis of said new relative positional relation between said imagestoring apparatus and said display in said second step.
 5. A methodaccording to claim 1, wherein said relative positional relation betweensaid image storing apparatus and said display is recognized by anacceleration sensor provided for said image storing apparatus.
 6. Amethod according to claim 1, wherein said relative positional relationbetween said image storing apparatus and said display is recognized byvideo data of said image storing apparatus photographed by a videocamera.
 7. A method according to claim 1, wherein said image storingapparatus is a camera which has a photographing function and can store aplurality of photographed images.
 8. A computer-executable programhaving program codes for allowing the computer to execute the step ofthe image displaying method according to claim
 1. 9. A display having animage display unit, comprising: a position information input unit forinputting position information of an image storing apparatus; and adisplay controller for displaying an image based on image data stored insaid image storing apparatus into a partial area on said image displayunit which has been determined on the basis of the position informationin said image storing apparatus inputted by said position informationinput unit.
 10. A display according to claim 9, wherein said positioninformation input unit inputs said position information from a positiondetector provided for said image storing apparatus.
 11. A displayaccording to claim 9, wherein said position information input unitinputs said position information from a position information detector.